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Abstract 


Power line communications (PLC) is the central communications technology for the realization of 
smart power grids. As the designated band for smart grid communications is the narrowband (NB) 
power line channel, NB-PLC has been receiving substantial attention in recent years. Narrowband 
power line channels are characterized by cyclic short-term variations of the channel transfer func¬ 
tion (CTF) and strong noise with periodic statistics. In this work, modeling the CTF as a linear 
periodically time-varying filter and the noise as an additive cyclostationary Gaussian process, we 
derive the capacity of discrete-time NB-PLC channels. As part of the capacity derivation, we char¬ 
acterize the capacity achieving transmission scheme, which leads to a practical code construction 
that approaches capacity. The capacity derived in this work is numerically evaluated for several 
NB-PLC channel configurations taken from previous works, and the results show that the optimal 
scheme achieves a substantial rate gain over a previously proposed ad-hoc scheme. This gain is due 
to optimally accounting for the periodic properties of the channel and the noise. 
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Chapter 1 


Introduction 


The frequency band designated for the automation and control of power line networks is the fre¬ 
quency range of 3 — 500 kHz Communications over this band is referred to as narrowband 

(NB) power line communications (PLC), and is an essential component in the realization of smart 
power grids. As the transition to smart power grids accelerates, the communications requirements 
for network control increase accordingly. Therefore, characterizing the fundamental rate limits for 
NB-PLC channels and establishing guidelines for the optimal transmission scheme are essential to 
the successful implementation of future smart power grids. 

Unlike conventional wired communications media, the power line was not designed for bi¬ 
directional communications, but for uni-directional power transfer, and its characteristics are con¬ 
siderably affected by electrical appliances connected to the power grid (2). It has been established 
that the narrowband power line channel exhibits multipath signal propagation ESI, and that the 
channel transfer function (CTF) and the noise statistics in narrowband power line channels vary 
periodically with respect to the mains frequency j5j IS ED . In accordance, the NB-PLC CTF is com¬ 
monly modeled as a passband linear periodically time-varying (LPTV) filter (5] [6} [TJ, and the NB- 
PLC noise is modeled as a passband additive cyclostationary Gaussian noise (ACGN) 12] [6] [8] [9]]. 
The overall NB-PLC channel is thus modeled as a passband LPTV channel with ACGN. 

The capacity of NB-PLC channels was considered previously in iflOTl . However, iflOl assumed 
that the CTF is time-invariant and that the noise is stationary. As the NB-PLC channel has fun¬ 
damentally different characteristics, the capacity expression of flOl does not represent the actual 
capacity of NB-PLC channels. In ifTTl the capacity of continuous time (CT) linear time-invariant 
(LTI) channels with ACGN was investigated via the harmonic series representation (HSR). To the 
best of our knowledge, no previous work derived the capacity of discrete-time (DT) NB-PLC chan¬ 
nels, considering the periodic properties of both the channel and the noise. In this work we fill this 

gap- 

Lastly, we note that the work 1T21 proposed a practical transmission scheme, based on orthog¬ 
onal frequency division multiplexing (OFDM), for LTI channels with ACGN , and |[T3l proposed a 
practical OFDM scheme for LPTV channels with AWGN. Following the same design principles as 
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in llT2l and lfT3l . we can obtain a practical transmission scheme, based on OFDM, which accounts 
for the periodic properties of both the CTF and the noise statistics. We will show that the optimal 
scheme derived in this work is substantially different from the practical scheme which follows the 
considerations used in previous works, and that the optimal scheme achieves significantly better 
performance. 

Main Contributions and Organization 

In this paper, we derive the capacity of DT NB-PLC channels, accounting for the periodic nature 
of the CTF and the periodic statistics of the noise by modeling the CTF as an LPTV filter |[5] [6] 
CD, and modeling the noise as an ACGN |8||9]]. We present two capacity derivations: Our first 
derivation applies the decimated components decomposition (DCD) to transform the channel into 
a static multiple-input multiple-output (MIMO) channel with no intersymbol interference (ISI) and 
with multivariate additive white Gaussian noise (AWGN), and then obtains the NB-PLC capacity 
as the capacity of the asymptotic MIMO model, obtained by taking the dimensions to infinity. Our 
second derivation uses the DCD to transform the channel into an LTI MIMO channel with finite 
memory and with additive colored Gaussian noise, and then obtains the NB-PLC capacity from the 
capacity of finite memory Gaussian MIMO channels derived in flT4l . Our work is fundamentally 
different from ifTTll in two major aspects: First, note that the capacity analysis of DT channels is 
fundamentally different from the capacity analysis of CT channels [fT5l Ch. 9.3]. Second, applying 
the approach of fill , namely the HSR, to our DT NB-PLC scenario leads to a transformed DT 
LTI MIMO channel with infinite ISI and with AWGN, whose capacity is unknown. We conclude 
that applying the DCD is the most appropriate approach for analyzing the capacity of DT LPTV 
channels with ACGN. From the numerical results it follows that in the practical scenarios studied, 
the capacity of NB-PLC channels is substantially higher than the achievable rate of the practical 
scheme based on lU2l and lU3l . 

The rest of this paper is organized as follows: In Chapter [2] the relevant properties of cyclosta¬ 
tionary processes are briefly recalled and the DCD is presented. In Chapter [3] the channel model 
is presented and a practical scheme based on lfT2ll and fl3l is reviewed, in order to form a basis 
for comparison with the capacity derived in this paper. In Chapter [4] the novel derivations of the 
capacity for LPTV channels with ACGN are detailed and the outage capacity of slow fading NB- 
PLC channels is discussed. In Chapter[5]numerical results are presented together with a discussion. 
Lastly, conclusions are provided in Chapter [6] 
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Chapter 2 


Preliminaries 


2.1 Notations 

In the following we denote vectors with lower-case boldface letters, e.g., x; the z-th element of a 
vector x (i > 0) is denoted with (x),. Matrices are denoted with upper-case boldface letters, e.g., X; 
the element at the z-th row and the j-th column (i, j > 0) of a matrix X is denoted with (X)jj. {■) n 
and (-) T denote the Hermitian transpose and the transpose, respectively. We use Tr (■) to denote the 
trace operator, | -1 to denote the absolute value when applied to scalars, and the determinant operator 
when applied to matrices, |_a,J to denote the largest integer not greater than a, and a + to denote 
max(0, a). We also use a%b to denote the remainder of a when divided by b, and * to denote the 
convolution operator. Lastly, Z, IN, and R denote the set of integers, the set of non-negative integers, 
and the set of real numbers, respectively, £[■] denotes the Kronecker delta function, Ijy denotes the 
N x N identity matrix, and E{-} denotes the stochastic expectation. 

2.2 Cyclostationary Stochastic Processes and the Decimated Compo¬ 
nents Decomposition 

A real-valued DT process x[n] is said to be wide-sense second order cyclostationary (referred to 
henceforth as cyclostationary) if both its mean value and autocorrelation function are periodic with 
some period, A^, i.e., E{x[n]} = E{x[n+iVo]}, and c xx (n, l) = E {x[n+l\x[n]} = c xx (n+No,l), 
see also HU Ch. 1], (171 Sec. 3.2.2], 

The time-domain DCD (171 Sec. 3.10.2], Ifl8l Sec. 17.2] transforms a scalar cyclostationary 
process x[m\ with period Nq into a multivariate stationary process of size Nq, represented as x[n] = 
[xo[n], xi[n],..., xjv 0 _i[n]] T , where x q [n] = x[nNo + q\. The process x[m] can be obtained from 
the vector process x[n] via 


TVo —1 oo 

x[m\ = ^2 Xi[l]5[m — i — INq]. 

2=0 l= — OQ 


(2.1) 
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Wide-sense second order stationary of the multivariate process x[n] follows since the cyclo- 
stationarity of x[n\ implies that E{xj[n]} = E{x[i + niVo]} = E{x[i]}, and c XiXj (n,l ) = 
E {xi[n + l]xj[n]} = c xx (j, i — j + INq), which depends on l but not on n. We note that the DCD 
is the implementation in DT of the translation series representation (TSR) originally introduced in 
m for CT cyclostationary signals. Another common transformation of scalar cyclostationary sig¬ 
nals into an equivalent multivariate stationary process is the harmonic series representation (HSR) 
m, sometimes referred to as the sub-band components decomposition (SBD) lfl8l Sec. 17.2]. 
The SBD transforms x[m] into a multivariate stationary process of size Nq, represented as x[n] = 
[x 0 [n\,xi[n],...,x No -i[n]] T , where with a k = we have x k [n\ = (x[n]e J ' 2,rQfe?1 ) * h 0 [n\, 
with h 0 [n] = j^sinc being an ideal low-pass filter (LPF) whose frequency response satisfies 

H 0 ( ui) = 1 for |cu| < and zero otherwise. The scalar process x[m] can be obtained from the 

Af 0 -t_ 

vector process x[n] via x[m\ = ^ Xfc[m]e _ - ?27r “ fcm . 


Chapter 3 


Channel Model and Related Works 


3.1 The Noise Model for NB-PLC 


Due to the relatively long symbol duration in NB-PLC transmissions, the periodic properties of 
the noise cannot be ignored ||6] [8J. Two important works, (8]] and 0, proposed relevant passband 
ACGN models for NB-PLC noise which account for the periodic time domain features. These two 
models, referred to herein as the “Katayama model” and the “Nassar model”, are also referenced in 
NB-PLC standards, see e.g., l20l . and are the baseline models for the numerical evaluations. We 
now briefly review these models: 

The Katayama noise model proposed in |(8] models the NB-PLC noise as a real, passband, 
colored cyclostationary Gaussian process, w[n\, with E{ w [n]} = 0, and with a periodic time- 
varying autocorrelation function c ww (n, l). For modeling c ww (n, l ), the work (8] Sec. III-B] defines 
Lnoise as the number of noise classes, each class i, i = 0 , f, ..., L no i se — f, is represented by a 
sine function parametrized by three parameters: the magnitude, A,., the power to which the sine 
component is raised, m, and the phase, Letting Tac denote the cycle duration of the mains 
voltage, the DT noise is obtained by sampling the CT noise at instances spaced T samp apart. The 
cyclic period of c ww (n,l ) is thus N no i se = ^ AC , where for simplicity we assume that T samp is 
such that N noise can be approximated as an integer. Lastly, letting a | be the coefficient of decay of 
c ww (n, l ) vs. I at any given time n, c ww (n, l ) is given by |8] Eq. (17)]: 



(3.1) 


Observe that the correlation between the noise samples is inversely proportioned to the square of 
the lag value l. 

The Nassar noise model proposed in 0 models the NB-PLC noise as the output of an LPTV 
filter with a white Gaussian stochastic process (WGSP) input. To that aim, the work in 0 si- 
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multaneously filters the input WGSP by a set of M LTI spectral shaping filters {hi[l]}fl_ 1 . The 
time axis is divided into blocks of length N no i se , which denotes the period of the noise statis¬ 
tics, and each block is divided into M intervals. At each time interval the noise signal is taken 
from the output of one of the M filters, with filter selection changing periodically. Define 0 = 
no < n\ < ri 2 < • • • < TiM-i < nM = N no i se . The M interval sets {7are defined 
as: IZi = {n £ Z : n ? ;_i < ( n%N no i se ) < rii}. Let I[n\ be a function which maps n into 
the index of the interval into which n belongs, i.e., if n £ 72,,, then I[n\ = io, and let v[n\ be 

OO 

a zero mean, unit variance WGSP. Define £i[n] = E Hn - M, *€{1,2,..., M}. It fol- 

l= — OO 

lows that the ACGN w[n\ is given by w[n\ = £/[ n ]M- The autocorrelation of w[n\ is obtained 

OO 

by c ww (n, l) = E hi[n+i] [ m i] ' hi[ n ] [mi — l]. If the filters hi[l], i = 1, 2,..., M, are finite 

mi =—oo 

impulse response (FIR) filters, it follows that the temporal correlation is finite, i.e., 3L corr > 0 such 
that c ww (^h 1 /) — 0, V |Z| A L corr . 

3.2 The CTF for NB-PLC Channels 

Following [5]1>][7| the NB-PLC channel is modeled as a linear transformation of the input signal. 
The impulse response of the power line channel is obtained by characterizing the impedances of the 
different electrical devices plugged into the network 0. Typically, these impedances depend on the 
level of the electric power, and are therefore periodic with a period of either half the mains period, 
or equal to the mains period j5][6j|3|. To accommodate these periodic variations, the NB-PLC CTF 
is modeled as an LPTV system whose period is equal to the mains period iStSEJ- We note that the 
LPTV model for the PLC CTF was originally proposed in lITHl for the frequency range 1-20 MHz, 
and was later confirmed to hold also for the NB-PLC frequency range in @ and j7). We use N c ), 
to denote the period of the DT CTF, and Li S i to denote the maximal memory of the channel, over 
all time instances n in one period of Ay./, consecutive samples (L. ISI is assumed finite). The CTF 
coefficients at any time instance n are given by {g[n, 1]}^1 q _1 , and satisfy g[n, l] = g[n + N c h, l]. 
Lastly, we note that the CTF varies also due to appliances being plugged into or out of the 
network, or switched on/off, and due to topology changes of the physical power line network. These 
variations are non-periodic long-term variations, and are not reflected in the periodic CTF model 
used in the present work. We will briefly discuss the performance implications of the long-term 
variations in Section [431 

3.3 The Overall NB-PLC Channel Model 

Since in NB-PLC, the period of the noise statistics and the period of the CTF are harmonically 
related 0, then, with a proper selection of the sampling rate, these periods are also harmonically 
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related in the resulting DT NB-PLC channelo Denote the least common multiple of N no i se and 
N c h with Ni cm . We note that in this work, the periods of the noise and of the CTF need not be 
harmonically related, but the sampling period is assumed to be harmonically related with Ni cm . 
Letting x[n] denote the transmitted signal and w[n\ denote the additive noise, the signal received 
over the DT NB-PLC channel is modeled as (n € Z) 

Lisi 1 

r[n] = ^2 g[n,l\x[n — l\ + w[n\. (3.2) 

z=o 

Note that as we use the bandpass signal model, then all the signals are real. We assume that the 
temporal correlation of w[n] is finitcQ i.e., 3L corr > 0 such that c ww (n,l ) = 0, V |/ > L corr . We 
also assume that the noise samples are not linearly dependent, i.e., no noise sample can be expressed 
as a linear combination of other noise samples. 

3.4 A Practical Transmission Scheme for NB-PLC Based on [fl2H and 

m 

The periodicity and frequency selectivity of narrowband power line channels can be handled by 
partitioning the time-frequency space into cells such that within each cell, the channel characteristics 
are approximately constant. This time-frequency partitioning is the underlying principle of the 
scheme proposed in lfl2l for NB-PLC channels modeled as an LTI filter with ACGN, and of the 
scheme proposed in fl3l for broadband PLC channels, modeled as an LPTV filter with AWGN ( Ifl3l 
included a footnote which explained how the scheme can be adapted for ACGN). In the following 
we detail the extension of this design principle to LPTV channels with ACGN: The time-frequency 
space is partitioned into cells. The temporal duration of each cell, denoted N sym , is set to an integer 
divisor of Ni cm , i.e., letting N p be a positive integer we write N sym = Let B to t be the overall 
bandwidth available for transmission and N sc be the number of subcarriers. The frequency width 
of each cell, B ce u, is therefore jf* 1 2 3 . These assignments divide the Ni cm x Btot time-frequency 
space into N p x N sc cells. If N sym and B ce u are set to be smaller than the coherence length and 
the coherence bandwidth of the channel respectively, then during the transmission of a symbol 
(of length N sym ) the channel at each cell may be treated as static and frequency non-selective, 
which facilitates the application of OFDM signal design as applied to LTI channels with stationary 

'As described in (5), modern NB-PLC systems are commonly synchronized with the zero-crossing of the AC cycle. 
In fact, sampling at a rate which is an integer multiple of half the AC cycle, results in N c h = 2N no i se HI ED- In this 
manuscript we shall allow a general relationship between the periods of the CTF and of the noise statistics. 

2 This condition is satisfied by the ACGN noise model proposed in (9), when FIR filters are used. For the noise model 
in (8) we observe from (ED that while Cn, w (n, 1)^0 for all l, for large enough |/| we have Cw W (n, l) « 0 and we 
can define an arbitrarily large value for which the correlation becomes small enough such that it can be neglected. The 
capacity of NB-PLC with the exact Katayama noise model is discussed in Section l4~TI 

3 As in ED , we use the terms coherence length and the coherence bandwidth to denote the range in time and frequency, 
respectively, in which the channel characteristics can be considered to be approximately static. 
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noise. We henceforth refer to this scheme as time-frequency (TF) OFDM. Note that as this scheme 
inherently limits the length of the OFDM symbol, N sym , to be shorter than the coherence length 
of the channel, the cyclic prefix (CP) inserted between subsequent OFDM symbols causes a non- 
negligible reduction in the spectral efficiencj@. 

At each time interval of duration N syrn , the scheme of fl2l transmits a single OFDM symbol 
corresponding to N sc subcarriers appended with N cp CP samples, where N cp is larger than the 
length of the ISF In order to accommodate the CP samples, N syrn must satisfy N sym > 2N SC + 
N cp . To evaluate the achievable rate of the TF-OFDM scheme, let | G[m, /;:] and rx 2 ( k denote the 
average channel gain (i.e., the average magnitude of the DFT of the CTF) and the average noise 
energy, respectively, at the k- th frequency cell of the m-th time cell, k E {0,1,, N sc — 1}, 
m £ {0,1,, N p — 1}. Define 7 m)k = and Q = {lm,k}m=oiZo and l et x\ n ] denote 

0 m.k ’ 


the transmitted signal. For a given average power constraint p, 

N p -\ N„ c -\ 


N, 


A o be the solution to the equation N L — 7 m k 

P SC m =0 k =0 ' 

the achievable rate for OFDM signals with finite block length in 
rate of the TF-OFDM scheme in bits per channel use is given by 


-1 


Nicm — 1 

Z) E{|x[n]| 2 } < p, let 

n=0 


= p. From the derivation of 
, it follows that the achievable 


Nsa~ 1 


Rtf- 


OFDM 


(Q) = 


N, 


l cm 


Y (log(A 0 -7 m,k)) + - 


(3.3) 


m =0 k =0 


4 As a numerical example we note that the length of the CP used in the IEEE P1901.2 standard 1201 is 55 qs, while 
the shortest coherence time according to, e.g, (ZD Sec. IV-A] is 600 qs. Thus, the rate loss due to restricting the symbol 
duration to be less than the coherence time can be as high as 9%. 







Chapter 4 


The Capacity of DT NB-PLC Channels 


In the following we derive the capacity of DT NB-PLC channels by transforming the original scalar 
model of (13.21) into a MIMO model using the DCD. Define g m [l\ = g[m, l], L = max { L corr , 

, and let K be an arbitrary positive integer s.t. K > K m i n . Let A aa 1 = KNi cm 


K ■ — 

1 m.rn. — 


Me 


denote an interval whose length is equal to I\ common periods of duration N[ cm . In the transformed 
MIMO model N^ K > represents the dimensions of the input vector signal, and M' h 1 = N^ K ’ — L+l 
represents the dimensions of the output vector signal. Lastly, define the M ih j x 1 vector w[n], s.t. 
(w[n])j = wlnN^ + i + L — 1], i £ {0,1,..., — 1} = Ai^ K \ and the x 

matrix CwJ[n] = E{w[n] (w[n]) 7 }. 

Lemma 1. CwJ[u] is independent ofn : Cw'J[n] = CwJ. 

Proof: At each n, CwwM i s obtained as 


(Cww[n]) = E{m 

V / u.v 

nN C^) + u + L — 1 

w 

nN {K) +V + L-1 

= C ww (v + L - 1, u - v) = 

f C (K) \ 

^WW ] 1 

^ / u.v 


u,v £ M^ K \ ■ 

Note that CwJ is full rank as the samples of w[m] are not linearly dependent. Define the 
MW x N ( k * matrix such that Vtt £ and Mv £ {0,1,..., — l} = A f^ K \ 

(G^ a ^) u v = g u+ L_i{L — 1 — v + u] if 0<v — u<L and (G^ a )) u y = 0 otherwise, i.e., 


G (K) = 


gL-i[L — 1 ] • • • gL- 1 [ 0 ] 


o ■ ■ ■ 5at(k)_i[^ 1] • • • gjy(K)_i [0] 


(4.2) 


where for l > Li S i we set g m [l\ = 0. Define G^f 1 = ^Cww) 2 G^ K \ and let k £ M^ K \ 
denote the fc-th eigenvalue of T* Aj = (g^^\ gI^' 1 . Our main result is summarized in the 
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following theorem: 

Theorem 1. Consider an information signal x[n], subject to a time-averaged per-symbol power 
constraint 

! N -' 

-^E{|*[n]| 2 }<p, (4.3) 

n=0 

received over the LPTV channel with ACGN (13.21) . Define the positive integer K s.t. K > K m i n . 

TVW-l . , N _i N + 

Select A (h } such that ff yA^^ — {^X' k j J = ■ p, and define 

n( k )~i 

R «-Wm s H) + - < 44 > 

k =0 

The capacity of the channel (13.2b with power constraint (14.31) is given by the limit 

cLPTV-ACGN = lim Rk- (4-5) 

K—too 

Proof: See Appendix |A] 

The capacity expression in (14.51 ) is characterized via a limit. In the following we present an 
alternative capacity expression which avoids the use of a limit. Define A() = and let w[n] 

be an Nq x 1 vector whose elements are given by (w[n])j = w [nNo + *], i € {0,1,..., No — 1} = 
A/q- Next, define the iVo x iVo matrices H[/], l G {0,1}, such that Vu, v G A/o, (H[0]) uu = 
g u [u — v] for 0 < u — v < L and (H[0]) u v = 0 otherwise, and (H[l]) u v = g u [Aq + u — n] for 
1 — Nq < u — v < L — Nq and (H[l]) u v = 0 otherwise, i.e., 



50 [0] 

0 

0 

H[0] = 

9L -1 [L — 1} ■ ■ ■ 

5L-t[0] ••• 

0 


0 

9n 0 -i[L - 1] ■ ■ ■ 

3/Vo-i [0]. 


'o--- Ogo[L-l] 

5o[l] 


H[l] — 

o o • 

' • o o • 

' • o o • 

9l-2[L - 1] 

0 



• • o 

• • o 

• • o 

0 



Let Cww (n,l) — E jw[n + l\ (w[n]) T | = Cww(0’ where the last equality follows as w[n] 
is a multivariate stationary process, since it is obtained from w[m\ using the DCD. Moreover, it 
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follows from the finite correlation of w[m] that (C„ (l)) uv = 0> V|/1 > 1, \/u,v G J\fo- For 
all u> G [—7T, 7 r), define the Nq x N o matrices H(w), S^(w), and £(tc), s.t. (H(w) 


£ (H[i]) u „ e~ jul , (Sww(w)) 4 £ (Cww(0) U) ,e-^,andE(a;) 4 (h( w ' " 
Z=0 Z=—1 v 

Lastly, let Aq(w), Ai(cu), ..., Ajv 0 -i(w) denote the eigenvalues of £(cc), u G [— 7 r, 7 r). 


u,v 


.-1 


-1 


:w)H(u;). 


ZVo-l TT / , 

Theorem 2. Let A he the unique solution to the equation -jz ff f ( A — I Afc(w)) ) due = 

_^ k = 0 CJ = -7T V ^ _ ' ) 

p ■ Nq. The capacity of the LPTV channel with ACGN (13.21) with power constraint (14.31) is given by 


! Nq-i n 

Clptv-acgn = - j — E J ( lo g( A ■AfcO 


ui 


duj. 


(4.6) 


Furthermore, the capacity-achieving input signal is a Gaussian zero-mean cyclostationary process. 
Proof: See Appendix [Cl 

Comment 1. Thm. Q]and Thm. [2] state the capacity of DT NB-PLC channels modeled as an 
LPTV system with ACGN. Note that LTI channels with ACGN are a special case of LPTV channels 
with ACGN obtained by letting N c f r = 1 and Ni cm = N no i se . Therefore, Thm. [Tjand Thm. [2] also 
apply to DT LTI channels with ACGN. 

In the following subsections we discuss the consequences of our results in Thm. [Hand Thm. [2] 


4.1 Capacity of Narrowband Powerline Channels with the Katayama 
Noise Model 

Thm. [j]relies Q n the assumption that the temporal correlation is finite. In the following we show that 

this assumption can be relaxed to the asymptotic independence assumption lim c ww (n, l) = 0 , as 

|Z|—>-oo 

is the case in the Katayama noise model ( 8 ). This result is stated in the following corollary: 
Corollary 1. The capacity of NB-PLC channels with Katayama noise is obtained by 

Ckata = lim R 2 l ■ (4.7) 

L —^oo 

Proof: Let Ckata denote the capacity of the NB-PLC channel subject to the Katayama noise 
model. Let K = 2 L and consider L corr large s.t. L = max { L corr , L lsl } = L corr . Let wr [n] be 
an ACGN whose autocorrelation function is c WLWL (n,l) = c ww (n,l ) for all n G Z and |/| < L, 
and zero otherwise. As L increases, the process w/fn] approaches w[n] in distribution and thus 

Clptv-acgn -a Ckata ■ Thus, lim R 2 l = Ckata ■ ■ 

L—yoo 


n 



4.2 Guidelines for a Practical Capacity-Achieving Transmission Scheme 
with Full CSI 

We now discuss the practical implementation of the capacity-achieving transmission scheme used 
in the proof of Thm. |T|(see Appendix lAl). Let d[t\ £ {0,1} denote an i.i.d. data stream with 
equal probabilities, and let p denote the average power constraint, both are provided as inputs to the 
transmitter. 

In the proof of Thm. [Q detailed in Appendix [A] we show that the LPTV scalar channel with 
ACGN can be transformed into a static MIMO channel without ISI and with AWGN. Therefore, 
when both the transmitter and the receiver know g[m, l] and c ww (m, l ), the capacity-achieving code 
design for static MIMO channels with AWGN If23l Ch. 7] can be used. For a large fixed N( k ) 3> 

L = max { L corr , L 1S1 }, both the transmitter and the receiver can use the CSI to compute G (/ ' ! and 
Cww. The transmitter employs encoding as in the optimal transmission scheme for static MIMO 
channels lf23l Ch. 7.1] to map the data stream d[t] into a transmitted multivariate stream x[n]. 
The physically transmitted scalar signal x[m] is then obtained from x[n] using the inverse DCD. 
The receiver transforms the received scalar signal r[m] into the multivariate stream r[n] using the 
DCD and discards the first L — 1 elements of each received vector. The data stream is recovered 
from r[n] using MIMO post-processing and decoding, as detailed in lf23l Ch. 7.1]. It therefore 
follows that the capacity-achieving scheme of Thm. Q]is feasible in the same sense that the optimal 
capacity-achieving scheme for static MIMO channels with AWGN ll23l Ch. 7] is feasible. 

4.3 Comments on the Outage Capacity of Slow Fading LPTV Chan¬ 
nels with ACGN 

The statistical model for the CTF of the power line channel was studied in (U, |[6j], and J24j]. The 
work lf24l also characterized the rate of the channel variations, and showed that the CTF changes on 
the order of minutes. Combining the statistical model of (4| with the long-term variations character¬ 
ized in lf24l . the NB-PLC CTF can be modeled as a random vector, which obtains a new realization 
every time the network topology changes (i.e., on a scale of minutes). This gives rise to the slow 
fading model for NB-PLC. As there does not exist a generally accepted statistical model for the 
NB-PLC CTF, we formulate the problem as communications over a slow-fading ACGN with a gen¬ 
eral random LPTV CTF without explicitly stating a probability density function (PDF) for the CTF. 
We then present a general expression for the outage capacity for such slow-fading PLC channels 
together with an upper bound on this capacity. 

Define the set of N c h ■ Li S i channel coefficients Q = {g[n, This set const i- 

tutes an N c h ■ Li S i x 1 multivariate RV with a PDF fg(■). For a specific realization of Q, the 
received signal is given by (13.2b . Since the receiver knows the channel coefficients, {g[n, /]}, and 
the autocorrelation function of the noise, c ww (n, l), it can form the equivalent MIMO channel ma- 
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trix G— 1 via (14. 21 ). and the covariance matrix of the noise C^w via (ED. The receiver can now 

_ i 

form the whitened MIMO channel matrix through = (^Cww j 2 G* k K For a fixed K, 

NW = KN lcm , L = max { L C orr- Tjs/}, and input covariance matrix C xx , the achievable rate is 
obtained as R f (C xx ,Q,N( k \L) = 2 ^ K) log 2 |l M( x) + G^f’C xx ^G^f^ | (see Eq. ( IA.6I ) in 

Appendix f/\1 ). where the subscript F is used for denoting the fact that the channels considered in 
this discussion are fading channels, instead of the static channel considered previously. 

When the channel realizations are not known to the transmitter, the transmission rate must be 
fixed, and an outage may occur. The outage probability for a target rate Rt and a given input 
covariance matrix C xx is given by 

Pontage (c xx , R T , N™, l) = Pr {l? F (c xx , G, N™, l) < R T ] . 

Let T N (k) be the set of all x 1 non negative definite matrices T satisfying Tr (T) < 

N^ !x 1 ■ p. The optimal input covariance matrix is the matrix C xx e T N (k) which minimizes 
Pontage (C xx , Rt, N^ k L). In order to avoid cluttering, in the sequel we denote the minimal 
outage probability with T, i.e., 

— min Poutage fc XX 1 R t ,N {k \l). (4.8) 

C xx £T n (k) v ' 


Since the optimal C xx in (14.81 ) depends on the PDF of the channel coefficients fg(-), it may be 
difficult to compute. We therefore provide an upper bound to T by selecting a specific arbitrary 
input covariance matrix which satisfies the power constraint. Setting C xx = pI N (K) , we obtain the 
following upper bound: 


4/ < Pr < 


log 2 |l Mm +pG<tP (G ( W K) 


2N( K ) 


< Rt 


(4.9) 


Note that while (14.91 ) is simpler to compute than (14.81) . it may not be tight, depending on the PDF of 

C?. 
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Chapter 5 


Numerical Evaluations 


In this chapter we numerically compare the capacity we derived in Section [4] with the achievable 
rates of the ad-hoc TF-OFDM scheme based on Ifl2l and Ifl3ll . described in Section I3T41 and demon¬ 
strate the benefits of the capacity-approaching coding scheme for practical NB-PLC scenarios over 
the TF-OFDM scheme. The achievable rates of the TF-OFDM scheme were evaluated using (I3.3I ). 
The discussion in Section Q] implies that there is no basis for comparison between the present work 
and the work of ifTTll . hence the results of IfTTil are not evaluated in this chapter. 

In the numerical evaluations we consider the frequency band up to 150 kHz, which is in accor¬ 
dance with the European CENELEC regulations If25l . The sampling frequency is 300 kHz. Two 
types of noise are simulated - 

1) ACGN based on the Nassar model (9| using two sets of typical parameters specified in the 
IEEE P1901.2 standard l20l . referred to in the following as TEEE1’ and ‘IEEE2’: 

• ‘IEEEF corresponds to low voltage site 11 (LV11) in 1201 Appendix G]. 

• ‘IEEE2’ corresponds to low voltage site 16 (LV16) in l20l Appendix G]. 

Each filter in the implementation of the LPTV noise model consists of 8 taps, implying that L corr = 
7. 

2 ) ACGN based on the Katayama model |f8j with two sets of typical parameters, referred to in 
the following as ‘KATA1’ and ‘KATA2’: 

• The parameters for ‘KATA1’ are taken from [(8j] and are set to be {no, n]. n 2 } = {0,1.91,1.57 • 
10 5 }, {0 O , ©i, 0 2 } = {0, -6, -35} degrees, {A 0 , A 1 ,A 2 } = {0.23,1.38, 7.17}, and on = 1.2 • 
10 -5 . 

• The parameters for ‘KATA2’ are taken from l26l residence 1], and are set to be {no,ni,n 2 } = 
{0,9.3,5.3 • 10 3 }, {0o,0i,02} = {0,128,161} degrees, {A 0 ,A 1 ,A 2 } = {0.13,2.8,16}, and 
ai = 8.9 • 10" 6 . 

In the capacity evaluation for the Katayama model via Corollary [Q L corr was selected to be the 
smallest value for which c ww (n,l ) is less than 10 -3 of its peak value. This resulted in L corr = 9 
for ‘KATAl’ and L corr = 11 for ‘KATA2’. 
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Two CTFs are used in the evaluations: a static flat channel, denoted in the following as ‘Flat’, 
and an LPTV channel, denoted in the following as ‘LPTV’. As there is no universally acceptable 
CTF generator for NB-PLC lf27l . we shall follow the approach of Q and generate the CTF based 
on transmission line theory, similar to the approach used in |28l for broadband PLC. The channel 
generator proposed in ll28ll was adapted to NB-PLC by setting the intermediate impedances of the 
model, Z\, Zo, and Z,>„ to series RLC resonators with resistance of 17A;Q, 8A;Q, and 26ATI, respec¬ 
tively, capacitance of 0 .6nF, InF, and 3.7 nF, respectively, and inductance of 11 mH, 2.3 mH, 
and 6 mH, respectively. These values correspond to frequency selectivity in the band of up to 150 
kHz. The short-term temporal variations of the channel were realized by setting the time-varying 
behavior of Z\ and Z :j to the harmonic behavior (see |;28A Pg. 168]), with a phase of ^ and j, 
respectively, and setting the time-varying behavior of Z 2 to the commuted case (see j28l Pg. 168]), 
with duty cycle of | of the mains period. The rest of the parameters used by the channel generator 
were set to the default values in |28l . Hence, the generated LPTV CTF captures the essence of the 
NB-PLC CTF. For the channel generated according to the above procedure, L lsl was taken as the 
largest time index after which the corresponding real-valued impulse response does not exceed 1% 
of the maximal tap magnitude. This resulted in Li S i = 8. Then, all filter coefficients beyond L lsl 
were truncated, resulting in an 8-tap filter realization. The results are plotted for various values of 



We determine the parameters of the TF-OFDM scheme based on the IEEE P1901.2 standard 
ll20l applied in the CENELEC environment li25il . From the specification in Il20ll we conclude that 
the ratio between the period of the noise and the duration of the OFDM symbol is 14.3, thus we set 


N p = 14. N sym is set to , and N sc is set to \_\{N sym - L isi + 1)J. 


1) Evaluating the Achievable Rates for Static Flat ACGN Channels: We first evaluated the 
achievable rates for static flat ACGN channels ( L 1SI = 1). The results for both noise models with 
the ‘KATAl’ and TEEEl’ parameters sets are depicted in Fig. 15.11 Since the channel is flat, then 
we can set the length of the cyclic prefix to N cp = 0, and thus N sym = 2N SC . As expected, the 
numerical evaluations of the capacity derived via Thm. [Hand that derived via Thm. [2] coincide. 
Note that the achievable rate of the TF-OFDM scheme is slightly less than capacity since in both 
the ‘KATAl’ scenario and the ‘IEEEl’ scenario, N sym is larger than the coherence duration of the 
noise, i.e., the statistics of the noise vary within a single OFDM symbol duration. 

2) Achievable Rate Improvement for NB-PLC Channels: Next, the achievable rates were eval¬ 
uated for NB-PLC channels, using the LPTV channel with ACGN model. The results for the LPTV 
channel with the Katayama noise model of (8| are depicted in Fig. 15.21 and the results for the LPTV 
channel with the Nassar noise model of @ are depicted in Fig. 15.31 It is clearly observed that the 
numerical evaluations of Thm. Hand Thm. H coincide, reaffirming the equivalence of the capacity 
expressions derived in these theorems. As expected, the capacity stated in Thm. Hand in Thm. [2] 
exceeds the achievable rate of the ad-hoc TF-OFDM scheme. Note that the rate of the TF-OFDM 
scheme is considerably less than the channel capacity especially at high SNRs, as at these SNRs the 
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—©■■■ Noise type = KATA1, Thm. 1 
—|— Noise type = KATA1, Thm. 2 

Noise type = KATA1, TF-OFDM 
—□— Noise type = IEEE1, Thm. 1 
—5fc— Noise type = IEEE1, Thm. 2 
- A- Noise type = IEEE1, TF-OFDM 




S' 

m 




5^' 






SNR. [dB] 


Figure 5.1: Achievable rate comparison for the ‘Flat’ channel. 



Figure 5.2: Achievable rate comparison the Katayama noise model of |[S[ for the ‘LPTV’ channel. 


rate loss due to the non-negligible cyclic prefix is more dominant. For the ‘KATA1’ noise model the 
loss varies from 2.9 dB at SNR m = 0 dB to 3.5 dB at SNR in = 10 dB, for the ‘KATA2’ noise model 
the loss varies from 2.8 dB at SNR in = 0 dB to 3.55 dB at SNR m = 10 dB, for the TEEE1’ noise 
model the loss varies from 2.7 dB at SNR m = 0 dB to 3 dB at SNR m = 10 dB, and for the 
TEEE2’ noise model the loss varies from 2.05 dB at SNR m = 0 dB to 2.9 dB at SNR, n = 10 dB. 
We thus conclude that optimally accounting for the time-variations of the channel in the design of 
the transmission scheme for NB-PLC leads to substantial SNR gains. 


16 













Figure 5.3: Achievable rate comparison for the LPTV noise model of @ for the ‘LPTV’ channel. 
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Chapter 6 


Conclusions 


In this paper, the capacity of NB-PLC channels was derived, and the corresponding optimal trans¬ 
mission scheme was obtained. The novel aspect of the work is the insight that by applying the 
DCD to the scalar LPTV channel with ACGN, the periodic short-term variations of the NB-PLC 
CTF, as well as the cyclostationarity of the noise, are converted into time-invariant properties of 
finite duration in the resulting MIMO channel. This was not possible with the previous approach 
which considered frequency-domain decomposition. In the numerical evaluations, a substantial rate 
increase is observed compared to the previously proposed practical TF-OFDM scheme obtained 
from 1121 and fOTl . Future work will focus on adapting cyclostationary signal processing schemes 
to MIMO NB-PLC channels. 
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Appendix A 


Proof of Thm. jj 


The proof of Thm. Q] consists of two parts: We first consider the channel (13.21) in which L — 1 
out of every N^ K > channel outputs are discarded by the receiver, and show that the achievable 
rate of this channel is given in (I4.4I ). Next, we prove that (14.41 ) denotes the capacity of the LPTV 
channel with ACGN when taking K —> oo. Let us observe the decomposed polyphase channel (13.21) 
depicted in Fig. IA.1I Fix K and define Xi[n] = x [nN^ + z], r j[rz] = r \nN^ + L — 1 + z], 
and Wi[n] = w [ nN + L — 1 + f]. For i G and n fixed, (lT2l) can be written as r t [n] = 

Y g \nN W 4- L — 1 + z,Z] Since the channel coefficients are periodic 

1=0 

with a period N c h, which is a divisor of N^ K \ it follows that g[nN ( A ^ + i + L — 1, 1} = g[i + L — 
1, l] = Hence, rj[n] can be written as 

Lisi 1 

ri[n] = ^2 gi+L-i[l]xi+L-i-i[n] + Wi[n], (A.l) 

1=0 

i G A4^ A) . Next, we define the M x 1 vector r[n] such that (r[n])j = ri[n], i G M^ K \ and the 
N( k ) x 1 vector x[n] such that (x[n]) n = x u [n], u G A f^ K \ With these definitions, we can write 


x[«]- 





T 


1 


Inverse DCD 


— 'Y 

DCD 


r oM 




Discarding the 
first L-l symbols 


r[n] 


Figure A.l: The transformed MIMO channel model obtained from the scalar DT LPTV ACGN 
channel by applying the inverse DCD to the input signal and the DCD to the output signal. 
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(1A.1I) as an equivalent x 1 MIMO channel 


r[n] = • x[n] + w[n]. 


(A.2) 


Note that the vectors w[n] and w[n + /],// 0, are jointly Gaussian as all of their elements are sam¬ 
ples of the Gaussian process w[m\. Since L > L corr , the vectors w[n] and w n +1] are uncorrelated 
(recall that the mean is zero), and are thus statistically independent Ml / 0. It then follows that the 
multivariate noise process w[n] is i.i.d. in time and has a jointly stationary multivariate zero-mean 

Gaussian distribution at every time instance n. Define w„, [n] = (E(E j " w[n]. Applying a noise 
whitening filter to the received signal, we obtain the following equivalent channel 

_ i 

r w [n] = 2 r[n] = G^xfn] +w w [n]. (A.3) 


Note that the noise of the equivalent channel, w w [n], is a multivariate AWGN process with an 
identity correlation matrix. With the representation (IA.3I) . the problem of communications over an 
LPTV channel with ACGN (13.21) is transformed into communications over a time-invariant MIMO 
channel with AWGN, i.i.d. in time, with the power constraint obtained from (14.31 ). Observe that 
each message is transmitted via an x B matrix X, with B being a large integer represent¬ 

ing the codeword length in the MIMO channel. It thus follows from (14.31) that x[n] must satisfy 
B-lArW-l 

B .X(K) E E IE{(x fc [n]) 2 } < p, thus A Y, E E{(xfc[n]) 2 } < ■ p. With this new 

n= 0 k= 0 n=0 k= 0 

MIMO average power constraint, the capacity is obtained as follows: Let T N (k) be the set of all 
x N^' 1 non-negative definite matrices T satisfying Tr(T) < A r! - A ) • p. The capacity ex¬ 
pression (in bits per MIMO channel use) for the equivalent channel (IA.3I) subject to the constraint 
B-lArW-l _ n 

j E E E{(xfc[n]) 2 } < N • p is well known |[29l Thm. 9.1lJ: 

n= 0 k= 0 


r (K) 

0 MIMO 


max 

c xx6T n ( K ) 



I M( k ) + 


GWC XX (GW) r 


(A.4) 


Note that in the transformation we drop L — 1 samples out of every 1 samples. As will be 
proven in Appendix |Bl this loss is asymptotically negligible when K —> oo, and thus, it does not 
affect the capacity. As is clear from j29l Thm. 9.1], the capacity of the MIMO channel (1A.3I) . stated 
in (1A.4I) . is obtained by input vectors generated i.i.d. in time according to a zero-mean multivariate 
Gaussian distribution with a covariance matrix C xx , which satisfies the given power constraint. The 
scalar signal x[m], obtained from the columns of X via the inverse DCD, satisfies E{ x [m]} = 0 

'We note that the theorem in 1291 Thm. 9.1] is stated for a per-codeword constraint. However, following |36| Ch. 7.3, 
pgs. 323-324] it is immediate to show that the proof of 1291 Thm. 9.1] also holds subject to the average power constraint 

B- 1 jv( k >-i 

b J(k) E E E{(*fcN) 2 } < p. 

n =0 k= 0 
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and 


c xx (m,l ) = E<M x 


m + l 
N( K ) 


J J / (jn+0%JVW 


X 


m 


n( r ) 


m%N ( K ) 



m + l 


rn 

— I'-'xxj (m+l)%N( K ) ,m%N( K ) 



Ljv(*)J _ 


(&) 


= c ra (m + 7V W ,0, 


where (a) follows since when 


m+l 

nTkJ 




rn 

NW) 


, the samples are taken from random vectors (RVs) 


with different time indexes, and as x[n] is i.i.d. over n and has a zero mean, the corresponding 
cross correlation is zero; and (6) follows since m can be replaced by m + N (/x ' without affecting 
the expression in step (o). This shows that the capacity-achieving input scalar signal x[m\ is a 
cyclostationary Gaussian stochastic process with period N^ K \ and therefore, the average power 
constraint (14.31) can be written as 


JVW-1 

Y V{{xk[n}) 2 } < p. 

k =0 


(A.5) 


Proceeding with the derivation, note that since each MIMO symbol vector is transmitted via N (K > 
channel uses, the achievable rate for the physical scalar channel (in bits per channel use) is given by 

1 r ~<( K ) i e 
N (K) ° MIMO ’ 1C -’ 


Rk 


max 


2N( K )c xx eT N(K) 


log 2 


[ M W+ G^C XX (GW) 


(A.6) 


It follows from |29l Ch. 9.1] that the eigenvectors of the matrix Cxx which maximizes (I A. 61) co¬ 
incide with the eigenvectors of We therefore write = VAV 7 , and Cxx = VDV 7 , 

where A and D are the x N (lx 1 diagonal eigenvalue matrices for the corresponding eigen¬ 
value decompositions (EVDs), and V is the x N ^ Kj unitary eigenvectors matrix for the 

EVD of rW. From ll29l Ch. 9.1] it also follows that the diagonal entries of D are obtained 
by “waterfilling” on the eigenvalues of T( k ' 1 : Letting = (A) fc ,k — 0’ waterfilling leads 


to the assignment (D) fcfc = ^A^) — ^ , k £ M^ K \ where A^) is selected s.t. 

AT(X)_1 

£ 

k =0 


1—1 / , .s -1 \ t- 

Tf(D)= £ ( J J = A* 7 ' > ■ p. Next, write the singular value decomposi¬ 


tion (SVD) of G^ as = UA^V 77 , where U is an M ( K ) x M (A) unitary matrix and A g is an 
M x N (,<! diagonal matrix which satisfies A^A g = A. Note that since rank (gIE) < iw, 
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then at most of the diagonal entries of A are non-zero. Plugging Cxx into (IA. 6 I) we obtain 


Rk = 


1 


2 N&) 


log 2 


+ GiPo£ (g<;P) 


(A.7) 


(a) 


1 




4- DA 5 A5| 


- ^^ lo g2lW)+DA| 


(c) 


1 


JVW-l 


2N( k ) 


E (log 2 (A<*>Af>))7 


(A. 8 ) 


k=0 


where (a) follows from Sylvester’s determinant theorem If30l Ch. 6.2]; ( 6 ) follows from Aj.As = 
A; and (c) is obtained by plugging the expressions for (D) fc k and (A) fe k . Note that (IA. 8 I) coincides 
with ( l4~4l) in Thm. Q] 

Next, we prove that for K —> oo, the capacity of the transformed channel (1A.8I) denotes the 
capacity of the LPTV channel with ACGN. Note that since the DCD leads to an equivalent signal 
representation for the LPTV channel with ACGN, the capacity of the equivalent model is identical to 
that of the original signal model. In the following we show that dropping the first L — 1 symbols out 
of each vector of length N' k 1 does not change the rate when K —>• oo. The intuition is that since the 
block length is N (/x: = KNi cm , where K can be selected arbitrarily large, and L is fixed and finite 
satisfying L > max {L corr , L ts j }, then, by letting K oo, the rate loss due to discarding L — 1 
samples out of every N' K ) samples approaches zero, and the capacity of the transformed MIMO 
channel asymptotically corresponds to the exact capacity of the original scalar channel with ACGN, 
see, e.g., l23l Pg. 181] and PTl Sec. III]. Mathematically, let /(•;•) and p(-) denote the mutual 
information and the probability density function, respectively. Also, for any sequence q[n\, n £ Z, 
and integers a\ < a 2 , we use to denote the column vector [g[ai],... , q[a 2 — 1 ]] T and q “ 2 to de- 


lai 

note qQ 2 . Let So £ S denote the initial state of the channel, i.e., So = (x^ L+ 1 ) r ,(w c 

N -1 

S = E 2(l_1) . Lastly, define /3n — jj E{|x[m]| 2 }, and 


L +1 




l T 


m =0 

1 


Ck (so) = j: sup I ( 


x fc ;r fc 


p(x k )--Pk<p 


So — so 


The proof combines elements from the capacity analysis of finite memory point-to-point channels 
in l32l , of multiaccess channels in l(33l . and of broadcast channels in | [34l . A complete detailed 
proof is provided in Appendix [B] In the following lemmas we provide upper and lower bounds to 
the capacity of the channel (13.21 ): 

Lemma A.l. For every e <G (0,1), 7 > 0, 3Kq > 0 such that VA: > Kq, Vsq £ S, the capacity of 
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the channel (13.21) satisfies 


Clptv-acgn < - - inf C k (so) + 7--77- + 7- 

1 — e s 0 e5 (1 — e) k 

Proof: Similarly to the derivation in ll33l Eq. (5)-(8)], it can be shown that for any arbitrary 
initial condition so, for all e, 7 > 0 and sufficiently large positive integer k, every rate R achievable 
for the channel (13.21) satisfies 

(1 - e) (R - 7) - ^ < C k (s 0 ) ■ (A.9) 

Since (IA.9I ) holds for all sufficiently large k, for e < 1, by dividing both sides of (1A.9I ) by 1 — e 
the lemma follows. Lemma [A. 1 1 is restated as Lemma fib 1 1 in Appendix iBl where a detailed proof is 
provided. ■ 

Lemma A.2. inf C n(k) (s 0 ) < K+ % min R K+K min - 

so Go 

Proof: First, recall that Rk denotes the capacity of the transformed memoryless x MW 
MIMO channel (IA. 6 I) . It therefore follows that Rk is independent the initial state and can also be 
written as lf29l Ch. 9.1] 


Next, similarly to the derivation leading to ll32l Eq. (32)], it is shown that inf N^C N (k) (so) < 

s 0 G<S 

]y( K + K min)R K+Km . n ' By dividing both sides by N^ K \ the lemma follows. Lemma fA.2l is restated 
as Lemma !bT 2] in Appendix IBl where a detailed proof is provided. ■ 

Lemma A.3. sup Rk < Clptv-acgn- 

Kmin 

Proof: This lemma is a special case of the more general inequality proved for the multiterminal 
channel in If34l Lemma 2]. From Il34l Lemma 2] it follows that any code for the equivalent channel 
in which L — 1 channel outputs out of every A r! - A > channel outputs are discarded, can be applied to 
the original channel (13.21 ) s.t. the rate and probability of error are maintained. This is done by using 
the same encoding and decoding scheme, where only the last M ' A ^ out of every A r * A ^ channel 
outputs are employed in decoding. It therefore follows that any rate achievable for the transformed 
channel is also achievable for the original channel (13.21) . Lemma lAAl is restated as Lemma fB.3| in 
Appendix IBl where a detailed proof is provided. ■ 

From the above lemmas we now conclude that for every e € (0,1), 7 > 0, 3Kq > 0 such that 


Rk = 


N( K ) 


V x 


sup / 

):P nW <P 


jvW . AT(ir) 

x > r L-l 
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VK > K 0 


(a) 

sup Rpr < Clptv-acgn 

K^Kmin 

Q>) i 1 

- ~ S° Nm (So) + (l-e)IVW + 7 
( c ) K + K m i n 1 

" (1 -e)K Rk+K+ (l-e)iVW + 7 ’ 

where (a) follows from Lemma [4.31 ( 6 ) follows from Lemma I aTTI (c) follows from Lemma [4.21 
As this is satisfied for all sufficiently large K, it follows that 

Clptv-acgn < Ijminf (L±L= fl;f+imin + (1 _ e ) JV(Jr) ) +T 

=-lim inf Rk + 7 - (A. 10) 

1 — e X—>■ oo 

Since e, 7 can be made arbitrarily small, (1A. 101) implies that 

Clptv-acgn < lim inf R K . 

K—too 

Lastly, it follows from the definition of lim sup 071 Def. 5.4] that lim sup Rk < sup R^-. 

K^o o K^K 

1 v ^ 1 *-rmn 

Since lim inf Rk < lim sup Rk, it follows that 

K->00 00 


Clptv-acgn = lim Rk, 

00 

which completes the proof that (1A.8I) denotes the capacity of the LPTV channel with channel for 

K —> 00 . ■ 
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Appendix B 


Detailed Proof of Asymptotic 
Equivalence for Thm. HJ 


Appendix [Aldetails the derivation of the capacity of DT LPTV channels with ACGN. The derivation 
is based on the analysis of the capacity of an equivalent channel, in which at each block a finite 
and fixed number of channel outputs are discarded, and the blocklength is an integer multiple of 
the least common multiple of the periods of the channel and the noise. The capacity is obtained 
by taking the limit of the blocklength to infinity, referred to in the following as the asymptotic 
blocklength. In this appendix we prove that at the asymptotic blocklength, the capacity of the 
equivalent channel is equal to the capacity of the original LPTV ACGN channel. Our derivation 
here follow similar proofs in lf32l Sec. IV], ll33l Sec. II], and f34l Appendix A], where the main 
difference follow as all these works considered LTI channels with colored stationary Gaussian noise, 
while we consider LPTV channels with ACGN. We use I(X;Y) to denote the mutual information 
between the RVs X £ X and Y £ V, H(X) to denote the entropy of X, p(X) to denote the 
probability density function (PDF) of X, and px(x ) to denote the PDF evaluated at x. For any 
sequence, possibly multivariate, q[m], m £ Z, and integers a\ < a2 , we use q “ 2 to denote the 
column vector [q[ai] T ,..., q[a2 — 1 ] T ] T and q a2 to denote qg 2 . 

B.l Definitions 

We begin with establishing the definitions for a channel, a channel code, achievable rate, memory¬ 
less channels, and block memoryless channels. 

Definition B.l. A channel consists of a ( possibly multivariate) input stream x[m] € X = R n ' ,: , a 
( possibly multivariate) output streams y[m] 6 }’ = R" H , m £ IN, an initial state So £ S = R” 3 , 
n x ,n y ,n s € IN fixed, and a sequence of transition probabilities {p (y f |x 4 , Sq) }^ Q , such that for 
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all t £ IN, p £ A’ 4 , So £ 5 


J Py*|x‘,s 0 (a*l/^> s o) da* = 1 . 

y* 

The observer of channel output y is referred to as the receiver. 

Definition B.2. Let n and R be positive integers. A [fi, n] code consists of an encoder e n which 
maps a message M uniformly distributed on A4 = {0,1,..., 2 n,i — 1 } into a codeword x n £ X n , 
i.e., 

e n :M^ X n , 

and a decoder d n which maps the channel output y" £ y n into a message word M, i.e., 

d n -.y n ^ M. 

The encoder and the message are assumed to be independent of the initial state So- 

Since the message is uniformly distributed, the average probability of error is given by 

2 nR _ f 

p e n) ( s o) = Tyji Pl '(dn(y n ) ^m\M = m,So = S 0 ) (B.l) 

m =0 

Definition B.3. A rate R is achievable for a channel if for every e, 7 > 0, 3no > 0 such that 
Vn > no there exists a [f?i, n] code which satisfies 


and 


sup (s 0 ) < e, (B.2a) 

soG 5 

Ri > R - 7 - (B.2b) 


The supremum of all achievable rates is called the channel capacity. 
Definition B.4. A channel is said to be memoryless if for every positive integer k 

k -1 

p(y fc |x fc ,S 0 ) = JJ p(y[m]|x[m]). 

m =0 


Definition B.5. A channel is said to be t-block memoryless if for every positive integer k 


p y 


r t-k\ t-k 


Sn = 


fc-i 

IT 

z=i 


y-i 1 y-i 

y t . (z _i)l x i. (z _i) 


(n) 

Note that the average error probability Pg is independent of the initial state So for memoryless 
channel and for t-block memoryless channel when n is an integer multiple of t. 
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B.2 Channel Models 


We consider a scalar passband DT LPTV channel with ACGN. Let w[m] denote the ACGN with 
period N no i se and finite memory L corr , i.e., c ww (m , l) = E {w[m + l\w[m]} = c VJW (rn + N noise , l ), 
Vm, l £ Z, and c ww (m,l ) = 0, V|Z| > L corr . Let //’m, l] denote the channel impulse response, 
whose memory is denoted by and period is denoted by N c h, i.e., g[m, l } = g [m + N c h, l ], 
Vm, l £ Z, and g[m,l] = 0, V|Z| > L^. Let x[m] denote the channel input and r[m ] denote the 
channel output, the input-output relationship of the channel is given by 

tjjsi 1 

r[m] = ^2 g[m,l]x[m — l] + w[m], (B.3) 

1=0 


a 2 — 1 


m £ {0,1,... , N}. For any integers oq < a 2 , define 0^ = Y, E{|x[m]| 2 } and 0 a2 = 


m=a i 


0 O 2 . We consider an average power constraint on the channel input 


N—l 


Pn = ^ ^ E{|x[m]| 2 } < p. 


(B.4) 


m =0 


In the following we refer to this channel as the linear periodic Gaussian channel (LPGC). We use 
Ni cm to denote the least common multiple of N no i se and N c i,. Define L = max { L lsl . ; L corr }. 
^y(A) a [{Ni cm , and 1 = — L + 1. Note that the LPGC is not memoryless, and that the 


(A +1 ) T ,(wVi) T ' 


€ 5 = E 2 ^" 1 ). 

le capacity of the LPGC. Similarly to 


initial state of this channel is So = 

In the sequel we analyze the asymptotic expression for t ■ 
the derivations of the capacity of the finite-memory Gaussian channels for point-to-point commu¬ 
nications 11321 . multiaccess communications ll33l . and broadcast communications P4l . for t > L 
we define the f-block memoryless periodic Gaussian channel (f-MPGC), which is obtained from 
the LPGC by considering the last t — L + 1 channel outputs over each f-block, i.e., the outputs of 
the f-MPGC are defined as the outputs of the LPGC for n%f > L — 1, while for n%t < L — 1 
the outputs of the f-MPGC are undefined. The f-MPGC inherits the power constraints of the LPGC 

(El. 

Note that the LPGC corresponds to the original LPTV channel with ACGN model (13.21) . while 
the f-MPGC, with f = N^ K \ corresponds to the equivalent channel used for obtaining the time- 
invariant MIMO model in the proof of Thm. Q]in Appendix lAl Therefore, Clptv-ACGN and IIk 
are the capacity of the LGPC and the capacity of the h '-MPGC, respectively. 


B.3 Equivalence of the Capacity at the Asymptotic Blocklength 

In the following we prove that Clptv-ACGN = lim Rk- We begin by proving the following: 

K=rOO 
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Proposition 1. The capacity of the N- R ! -MPGC is given by 


Rk= nW) sup ( B -5) 

Proof: In order to obtain the capacity of the ! -MPGC, we first show that (IB.51) denotes 
the max im um achievable rate when considering only codes whose length is an integer multiple of 
N^ k \ i.e, [Ri,b ■ codes where 6 £ I. Then, we show that every rate achievable for the 

iV( A -MPGC can be achieved by considering only codes whose length is an integer multiple of 

n( k \ 

Let us consider the ’-MPGC subject to the limitation that only codes whose length is an 
integer multiple of N ^ K; are allowed. In this case we can transform the channel into an equivalent 
n( r ) x memoryless MIMO channel without loss of information as was done in Appendix 

lAl We hereby repeat this transformation with a slight change of notations compared to that of 
Appendix |A] in order to maintain consistency throughout this appendix. These changes are clearly 
highlighted in the following. Define the input of the transformed channel by the N^ h > x 1 vector 
x e<? [h] — (corresponds to x[n] in Appendix [7\1 >. and the output of the transformed 

channel by the A x 1 vector r eq [h] = (coiTesponds to r [n] in Appendix lAl). 

The transformation is clearly reversible thus the capacity of the transformed channel is equal to the 
capacity of the original channel. Since the N^ K ^-MPGC is N ^ K '-block memoryless, it follows from 
Definition IB. -ll that the transformed MIMO channel is memoryless. The channel output is corrupted 
by the additive noise vectors w eq [h] = w(corresponds to w[n] in Appendix lAl). 
From definition it follows that w (;(] [n] is a zero-mean multivariate Gaussian process. From the 
properties of the DCD (see LemmaQ]) and the memoryless property of the transformed channel (see 
discussion following Eq. (IA.2I) in Appendix [7\1 >. it follows that w„ ( [h] is i.i.d. over n. Since we 
assume codewords of length h ■ , the average power constraint ( IB .41) implies that 

{ 6-1 ^ 6-a4M_i 

H x e g [;re]II 2 \ = b N{K) E {l x H| 2 } • n(K) <P- n(K) - ( b -6) 

h =0 ) m =0 

The capacity of the transformed channel with the constraint ( IB.61 ). denoted C^j MO , is well-established, 
and is given by J3U Ch. 10.3]: 

^MIMO ~ SU P 1 \ X ! r L-l j • '*>•') 

p(x n(K) )--P n (k)<P 

As each MIMO channel use corresponds to N^ K> channel uses in the original channel, it follows 
that the achievable rate of the )-MPGC subject to the limitation that only codes whose length is 
an integer multiple of N^ K i are allowed, in bits per channel uses, is N ( K ) which coincides 
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with llB.51) . 

Next, we show that any rate achievable for the AT^-MPGC can be achieved by considering 
only codes whose length is an integer multiple of N^ K K Consider a rate R achievable for the N^ h >- 
MPGC and fix £, 7 . From Definition IB. 3 1 it follows that 3no > 0 such that Vn > no there exists a 
[Ri,n] code which satisfies (IB.2al) - (IB.2bl) . Thus, by setting bo as the smallest integer bo for which 
b 0 ■ > no it follows that for all integer b > bo there exists a [R\,b- iV( A )] code which 

satisfies (IB.2al )- (IB.2bl ). Therefore, the rate R is also achievable when considering only codes whose 
blocklength is an integer multiple of N^ K \ We therefore conclude that Rk denotes the maximum 
achievable rate for the N^ K >- MPGC, which proves the proposition. ■ 


Proposition 2. Proposition\J\implies that for any arbitrary initial condition Sq 


Rk = 


1 


n( r ) 


V x 


sup 

n ( k ) 


Tl iV<A) JVW ic 1 

I ( X ;r L _ L |S 0 = So . 


P N (K) <p 


(B. 8 ) 


Proof: Note that C^j MO denotes the maximum achievable rate of an A r(/ ' j -block memoryless 
channel when considering only blocklength which are a multiple of N^ k K Thus, from Definition 
IB.5l it follows that C^fj MO is independent of the initial state. Since Rk = Caiimo > follows 

that Rk is also independent of the initial state, hence (IB .81) follows from (IB.51) . ■ 

Before we proceed, let us recall the definition of Ck (sq): 


Ck (s 0 ) — T sup I 
p(x k ):/ 3 k <p 



Proposition3. Clptv-ACGN < inf ( lirn inf Ck (sq) 

soS S y k—roo 

Proof: We prove the proposition by showing that every rate R achievable for the LPGC satisfies 
R < liminf Ck (so) for any initial condition so- By definition, if R is achievable then for every 

k — yoo 

e ,7 > 0 and for all sufficiently large n there exists a [Ri,n] code, i.e., a code with blocklength n 
and a message M uniformly distributed over A4, such that (IB.2al) - (IB.2bl) are satisfied. Fix an initial 
condition sq, since conditioning only reduces entropy it follows that 


H (M| r”, S 0 = s 0 ) 


(a) 

< 1 + Pr 


(M / M 



nRi 


(&) 

< 1 + e ■ nRi, 


(B-9) 


where (a) follows from Fano’s inequality [131 Sec. 2.10] and ( 6 ) follows from (IB.2al ) since 


Pr ( M f M 


so 


So = s o) < supPr (M Af|So = sq j < e 
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Therefore, 


/ (M; r n [ S 0 = s 0 ) = H (M| S 0 = s 0 ) - H (M\ r n , S 0 = s 0 ) 

(a) 

> H (M| So = so) — 1 — e • nR\ 

= nR\ — 1 — e ■ ni?,i, (B.IO) 


where (a) follows from (IB.9b . and (c) follows since M is uniformly distributed and independent of 
sq, thus H ( M | Sq = Sq) = H (M) = nR\. Combining (IB.2bl) and (IB. 101) leads to 


thus 


R — 7 < 


/ (M; r n | S 0 = s 0 ) + 1 
n (1 — e) 


(l_ e )( i? _ 7 )_I<I / ( M;r n|S 0=S0 ) 

n n 
(a) i 

<- sup /(x n ;r n | So = So) 

n p(x n ):/3 n <p 

= C n (s 0 ), (B.l 1) 

where (a) follows from the data-processing lemma lfl5l Sec. 2.8] as M\Sq —> x n |So —> r n |So form 
a Markov chain. Since (IB.Ill) holds for all sufficiently large n, it follows that 


(1 - e) (R - 7 ) < lim inf C n (s 0 ). 

n—>• 00 


(B.12) 


Since e, 7 can be made arbitrarily small, (IB. 121 ) implies that for all so, R < lim inf C n (so). ■ 

n—>00 

We now repeat the lemmas stated in Appendix lAl and provide a detailed proof for each lemma. 

Lemma B.l. For every e € (0,1), 7 > 0, 3N > 0 such that Vn > N 

Clptv-ACGN < - - inf C n (s 0 ) + —-r- h 7. (B.13) 

1 — e s 0 e<s (1 — e) n 

Proof: This lemma follows immediately from Proposition [3} as (IB.l II) is satisfied for all rates 
achievable for the LPGC, for all initial states sq. As e < 1, dividing both sides of (IB.l II) by 1 — e 
leads to (IB. 131) . ■ 

Lemma B. 2 . inf C n{k) (s 0 ) < R K+Krnin - 
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Proof: Note that 


jy(K+K m i n ) 


I\-\-Krnin 

sup 


T I jyi^+Kmin) j\T 

1 I x > r L-l 


(a) 

> 


sup 


(b) 


(o) 


P X 


( Y ( K+Krn.in ) V />JV ( nu/n .) - n / 

P x " )'-P IK \ —P’ ^ , (K ■ t<P 

\ / pjx^min) AAV mm) 

sup 

< p 

\ / N\*^min) A/\ min) 

sup / 


t I N( K + K min) m ]SJ(K+Kmin') 
^ Pf( K min) ’ r 7v( K rnin) 


X 


Pfi^min ) pji^min) 


i L L-l 


t I N ( K^-^min ) TV ( ) 

X Ar( K min) N( K min) 


Pfi^-min ) Pfi^min ) 

AK K min)_L+-l’ jv( Kmin )—L- 1-1 


T I pj(K+K m in) pj(K-\-Kmin) 
X pf( K min) ’ r Tv( K "i^) 


Pfi^-min) Pfi^min) 

Pf{ K min )—L -(-1 ’ pf ( K min )—ZH“1 


H») 


x p N ^ min ) N {K min ) (so) rfso 

X / \ 5 W / \ 

pj\ K min )_£^i 


(d) 

> inf sup 

/ ^(K+Krnin) V / qAr(- f ^+^min) 

V min 


T I N^f-Kmin) _ Pf(^~^^min ) 

^Pfi^min ) ’ Pj(^min) 


Pj(^min ) Pfi^min) 

Pf(K-min) —ZH-1 5 ^N( K min )-L\-l 


<P 


}=s„) 


(e) . , 

= mt sup 

S ° eS p(x Jv(K) ): 0 n{K )<P 

= ini N^C n(k) (s 0 ), 

so Go 


/{x iVW ivw 


So —so 


(B-14) 


where (a) follows since adding power constraints can only reduce the supremum, and from the 
mutual information chain rule fl5l Ch. 2.4], as 


/ x 


Pf{,K-\-Kmin) ^Pfi^+Kmin) ^ _ j / min ). jv( ^ min ) 


> 1 L-l 


> 1 L-1 


T I Pf\^^~^min ). jv( K min) 

= 1 I x i r L-l 


+ / X 


JY(X+X m j n ) ( ^^^rn.iri ) 


jvC^ 


0 


aKN- 

r L-l 


+ / X 


jvl* min ) Pf ( Kf-Kmin ) 


i) 


, t I Pf(K-\-Kmin) ^pfi^f-Kmin) 
X Ar(- Rr min) 


j I pj(K-\-Kmin) _ pf{^~^^min) 

X J\ r( K min) ’ ^J^{ K min) 


n(P 




X 


jv( jc 

j. ) y( 

> r L—1 


n( K ” 

r L-1 


X 


) „tv( x min) 


i l L -1 


(6) follows from the definition of the LPGC (IB.31) . as the the input-output relationship is affected 
only on the previous L — 1 channel inputs and channel outputs, and p can be determin¬ 
istically obtained from and ( c ) follows from the definition of the conditional 

mutual information lf36l Ch. 2.4], noting that sq represents the realization of L — 1 pairs of samples 
of x[n] and i/;[n]; To justify (d), we first define the mutual information evaluated with a PDF p (•) 
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on the channel inputs X A^ +Kr ™ n ) as 

1 A J\ K min) 


/ ]\j{^min ) ]\[{^min ) 'l 

\ N{ K min )—’ ]\[{ K min )—£_|_1 J ^ 

Since the conditional mutual information is continuous, it follows from the mean value theorem for 
integration lf38l Ch. 10.2] that for any p (•), 3sq G S such that 


X ]\r( K min) ’ r ]\f( K min ) 




sqE<S 


{ ]y(K-\-Kmin) ]\[ ( min ) 
\ A 5 ]\f( K min) 


/ ) 

\ AT( K rnin)-I H -l 


w 


]\[( K min ) 

tv ( K-min )-Lr\-l 



p X 


AT 

AT 


{^min ) 

min ) 


-i-fl 


.Ar(*min) ( § 0)^0 

7vr( Km in. ) r n 


= / 


= / 


r N( K+K rr 


X 


») 


l ) jyi^+Kmin 
5 


X 


r ]y( K r, 

n ( K n 


i) ]y(Kmin) 

0-l-hl’ jv( x min)—£r(-l 


M), 


/ 


p 


■iv( X : 


0 


min] N^^min 

\ , W - 

)—L+i at( k ' 


S 0 €<S ATV“mzn;_ L+ i 

A j(,K~\~Kmin) ]\J ( ^min ) 

’ A filmin') 


) (§o) ds 0 

) -L+l 


X 


jv(* 

iv(* 


0 


1 ) „jv(" mm 

i). L+1 ' W N (K min ) —A+l 


ML- 


(B.15) 


Note that the mean value theorem for integration requires the integral to be defined over a finite 
interval. However, since 


J 

sqE<S 



iV 


(^min ) 


-L+l 


,W J 




-Z,+l 


(so) rfs 0 = 1, 


it follows that the probability density function approaches 0 for ||so|| —>• oo, therefore the integral 
can be approached arbitrarily close by considering finite intervals, i.e., integrating over ||so|| < H 
for sufficiently large Q, instead of over 5 = ]R 2i . Let p* (•) denote the input PDF which maximizes 


sup 

^N^K+Kmin) \ . 
AT^ min ) 


\ . oN^''~ r ^'"rmn) 

J N^min) 


<P 


( N^^+Kmin) # ATO^+^min) 
y ^]\f(^min) l^]\[(Kmin) 


( JSf^^min ) J\[( K min) ) _ 

\ X W(X m in)-L+l ’ W N^min)-L\-\ J — S 0 
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It then follows that 


inf 

Sq€: S 


P X 


n( k min ) 


sup 


T I N ( K+^min ) _ N(min ) 

^ jji^min ) 5 jj(^min) 


\K 

min ) 


<p 


{ 


N min ) N(^min) 

^N^ K min)-L\-\ ’ JSfi-^min)— 


}=S 0 ) 


_ • £ T l N^^+Kmin) _ Pf(^^~^min) 

— ml 1 | X jy(x min ) ) r N( K min) 


soG«S 

< /■ f Ar( K+K min) . Arf^+^min) 

N^ Krnin ) ^ pp min ) 


f N^^min ) 

I ^N^min )-I+l ’ W 7V( ^min 1-14-1 


O') 


/ 


]\j(K-\-Kmin) ]\[ ( ^^^min ) 

]\[{^min ) ’ JSfi^min ) 


N( K r> 
N( K n 

]\[{^min ) 

i vF 

) ~.n( k ” 


, Ar( K mi7 l )_L + .i’ jv( ^rrrin )— 


x) 


fxJvl^ w 

L N( K ™in )_I+l’ JV( ^min )—T^f-1 


} =s °)„ 
} =B «) P . 
H»), 


* P jyi^min ) 


jy^^min )—£-1-1 jv(^ min )—Irfl 

f pji^min ) pji^-min ) 

L A^( K ^)-L-hl’ 7V( Kmin )-L- 1-1 y 


,(*m4n) ( S °) di ° 


sqG«S 


< 


P x J 


j{.K+Kmin) 


sup 

0 w( K+Kmin) ^ n ~ ° ^ 

P (K .) ^ P N (K min )^P s 0€«S 

jSfK^mm) iW mm) 


I X 






») 


; r 




») 


=So 


X p tic 'i tic t (so) tJ?Sn, 

r x Aft mm / w ATv min) ' ^/ w 7 

Namin ')—£-|_i jsii^min)—]^ 


in (z), Sq is selected such that the mean value theorem as restated in dB. 15b is satisfied for some 
p ^ K N< - Kmm ^ which satisfies the power constraint f3 N (K rnin ) < p\ (J) follows from the mean value 

theorem and the selection of p ("x x (fsr ™ n) ^ and Sg as stated in step (i); (e) follows from the defini¬ 
tion of the LPGC (IB. 31) . as the joint probability function is invariant to index shifting by a number 
of samples which is an integer multiple of Ni cm , noting that the RV So represents L — 1 pairs of 
samples of x[n] and m[n]. 

Dividing both sides of (IB. 141 ) by iV^ leads to 


a mf.C N( „ (so) < 


J\ X 

A' + A n 

A 




sup 


r / _A r(K+ ^min ) ]\f(K-\-Kmin ) 

1 l x 5 r L-l 




Rk+k„ 


This proves the lemma. ■ 


Lemma B.3. sup Rk < Clptv-acgn- 

K^> Kanin. 

Proof: We now show that for any rate A achievable for a A^ A j -MPGC, K > K m i n , is also 
achievable for the LPGC, i.e., for all e, 7 > 0, if we take a sufficiently large to, then there exists 
a [R \, to] code for the LPGC such that (lB.2ab - (lB.2bb are satisfied. The proof follows the same 
guidelines as that of ll34l Lemma 2]. We first show this for n an integer multiple of N^ K \ then 
we prove this true for all sufficiently large n. Fix K > K m i n and consider a rate R achievable for 
the A t - /n )-MPGC. Then, for any 6,7 > 0, 3bo sufficiently large, such that for all integer b > bo, 
there exists a [R\,b ■ A'^Aj co de for the A^^-MPGC with average error probability which satisfies 
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(lB.2al) . and code rate which satisfies 


Ri > R — 


7 


(B-16) 


We denote this code by C b . N (K). Note that as the channel is N (k )-MPGC, the C b . N (K) code only 
considers the last ) channel outputs out of each N'> channel outputs for decoding. 

Next, apply the code C b . N (K > to the LPGC. The rate is unchanged. Since the decoder considers 
the last M( k ^ channel outputs out of each channel outputs, the error probability is also the 
same as that of the JV^-MPGC. Consequently, for n = b ■ N- K \ there exists a code for the LPGC 
with the desired rate and an arbitrarily small error probability for all so, assuming large enough b. 

We now extend this coding scheme for the LPGC to arbitrary values of n. Specifically, we write 
n = b ■ N^') + o, where b is an integer and a £ M^ K \ We define a R.\ b b ^^ +a , b ■ + a 

code for the LPGC by appending a arbitrary symbols to the codewords of C b . N (K) . The decoder 
discards the last a channel outputs. Clearly, for all so, the error probability is the same as that of the 
C b . N (K) code since the decoders operate on the same received symbols. The code rate is obtained by 

b-NW (“) / 7 \ b-NW 

Rl b ■ N ( K ) + a ~ \~2) b-N( K ) + a 

where (a) follows from (IB. 161) . Thus, for sufficiently large b, it follows that 

Ri > R — 7 . 

We therefore conclude that any rate R achievable for a N^ K -MPGC can be obtained by a \R\. n] 
code for the LPGC for any sufficiently large n. ■ 

We conclude that for every e G (0,1), 7 > 0, 3 Kq > 0 such that ViT > Kq 


(a) 

sup Rk < Clptv-acgn 

(b) 1 

< -- mf C N ( K ) (s 0 ) + 


1 


1 — e s 0 g<s 
(g> K + K min 
~ (1 -e)K 


RK + Kmir, + 


(1 -e)N( K ) 
1 

(1 - e) N( K ) 


+ 7 

+ 7, 


(B.17) 


where (a) follows from Lemma HOI (6) follows from Lemma iBTl (c) follows from follows from 
Lemma HOI As (IB.171) is satisfied for all sufficiently large K, it follows that 


Clptv-acgn < M (^f^~7fw RK+Kmin + 

=-lim inf Rk + 7. 

1 — e K —>00 


(1 - e) N( R ) 


+ 7 


(B.18) 
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Since e, 7 can be made arbitrarily small, (IB.181) implies that 


Clptv-ACGN < lim inf Rk ■ (B.19) 

K—too 

Lastly, it follows from the definition of lim sup ll37l Def. 5.4] that lim sup Rk < sup Rk- 

K ^00 KK jji-iji 

Since lim inf Rk < lim sup Rk, it follows that (IB. 171) yields 

K^r 00 K-> 00 


C = lim Rk- 

K—too 


We have therefore shown that the capacity of the discrete time LPTV channel with ACGN can be 
obtained, to arbitrary accuracy, from the capacity of the equivalent channel with a finite number of 
of channel outputs discarded on each block, where the size of each block is an integer multiple of 
both the period of the LPTV channel and the period of the cyclostationary noise, for all sufficiently 
large block sizes. 
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Appendix C 


Proof of Thm. 2 


The result of Thm. [2] is based on the capacity of finite memory multivariate Gaussian channels 
derived in llT4l . Define the JVq x 1 vectors x[n] and r[n] whose elements are given by (x[?r]) i = 
x [niVo + i] and (ffn])^ = r [uNq + i], respectively, i € A/jj. Recalling the definitions of w[n] and 
H[Z] for Z = 0,1, we note that (13.21) can be transformed into 

t 

r[n] = ^ H[Z]x[n — l] + w[n]. (C.l) 

1=0 

Since w[n] denotes the DCD of the ACGN w[n\, it follows that w[n] is a stationary multivariate 
Gaussian stochastic process. Moreover, as the statistical dependance of w[n\ spans a finite interval, 
it follows that the statistical dependance of the transformed multivariate noise w[n] also spans a 
finite interval. Thus, (1C. II) models a multivariate stationary Gaussian channel with finite memory. 
Let B denote the codeword length in the equivalent MIMO channel, since the transmitted vector is 
subject to power constraint (14.31 ). the transmitted signal in the equivalent channel (1C. II ) is subject to 
the average power constraint 


B-lNo-l 

(C2) 

u 71 =o k =o 

Note that the scalar channel output is obtained from r[n] using the inverse DCD, hence the trans¬ 
formation which obtains (1C. II) from (13.21 ) is reversible, and the capacity of the equivalent channel 
(1C. II) is clearly equal to the capacity of the LPTV channel with ACGN (13.21) . Following the capac¬ 
ity derivation of multivariate stationary Gaussian channels with memory in ffT4lR let A denote the 

*We note that C3 Thm. 1] is stated for a per-codeword constraint. However, it follows from the proof of 01 Lemma 
3] and from {36] Ch. 7.3, pgs. 323-324] that fll Thm. 1] holds also with an average power constraint dC.2b . 
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unique solution to lfl4l Eqn. (9a)j^| 

JVo-l 

^ E , 


A- 


u 


-i 


doj = p ■ Nq, 


then the capacity of (1C. 1 1) is given by lfl4l Eqn. (9b)] 

Nq — 1 


■ - 4, 


Y. / ( lo e( A '^(‘ 


ui) ) ) duo. 


(C-3) 


Note that (1C.31) is in units of bits per MIMO channel use, as it denotes the capacity of the equivalent 
MIMO channel. Since each MIMO channel use corresponds to N 0 scalar channel uses, the capacity 
of the original scalar channel is thus 


1 No-l J 

Clptv-acgn = J ( lo § • Xk (“ 


ui )) 1 du. 


Lastly, note that the capacity achieving x[n] is a zero-mean iVo x 1 multivariate stationary Gaussian 
process d, thus, the for the scalar channel, the capacity achieving x[n], obtained via the inverse 
DCD of x[n], is a cyclostationary Gaussian process with period Nq. This completes the proof. ■ 


2 I14I Thru. 1] is stated as follows: Let the sxs matrix F (8) = H (0) _1 R(9)H (8)~*, and let Ai(8), Xiid),..., \ s (8) 
be the eigenvalues ofT(8), —n < 8 < n. Then, \j(8) > 0, 1 < j < s, —n < 8 < n. Let S > 0 be given, and let K s 
be the (unique) positive number such that 


1 

27T 



d8 max [0, K s 


A j{8)] = S. 


Then 

Cs = ^±jd8m^(o,lo g2 ^y). 

3 —7r 

N -1 

The power constraint is given by jj Y2, || a?i (n) || < S for each message i 114] Eqn. 3], and the sxs matrices H(8) 

71 = 0 

and R(8) are obtained as the DTFT of the multivariate CTF ll4l Eqn. 5] and of the autocorrelation function of the 
multivariate noise 03 Eqn. 8], respectively. 
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